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Abstract 

A path information is denned in connection with the different pos- 
sible paths of chaotic system moving in its phase space between two 
cells. On the basis of the assumption that the paths are differenti- 
ated by their actions, we show that the maximum path information 
leads to a path probability distribution as a function of action from 
which the well known transition probability of Brownian motion can 
be easily derived. An interesting result is that the most probable paths 
are just the paths of least action. This suggests that the principle of 
least action, in a probabilistic situation, is equivalent to the princi- 
ple of maximization of information or uncertainty associated with the 
probability distribution. 
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1 Introduction 

The aim of this work is to investigate the probability distributions attributed 
to the different paths of chaotic system moving between two points in the 
phase space Y. As usual, the phase space T of a system is defined such 
that a point in it represents a state of the system. For a A^-body system 
moving in three dimensional ordinary configuration space, the T-space is 
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of 6N dimension (3N positions and 3N momenta) if it can be smoothly 
occupied. 

Now we look at a nonequilibrium system moving in the T-space between 
two points, a and b, which are in two elementary cells of a given partition of 
the phase space (Figure 1). We will use the concept of trajectory or path of 
classical mechanics. If the motion of the system is regular, or if the phase 
manyfold has positive or zero riemannian curvature, there will be only one 
possible trajectory between the two points, or, in other words, there will be 
only a fine bundle of paths which track each other between the initial and the 
final cells. These trajectories must be the paths minimizing action according 
to the principle of least action[l, 2] and have unitary probability. Any other 
path must have zero probability. 

For a system in chaotic motion, or when the riemannian curvature of the 
phase manyfold is negative, the things are different [2] . Two points indis- 
tinguishable in the initial cell can separate from each other exponentially. 
Normally, these two points, after their departure from the initial cell, will 
never meet each other in a final cell in the phase space. However, it is possi- 
ble that they pass through a same cell at two different times. So between two 
given phase cells represented in Figure 1 by a and b, respectively, there may 
be many possible paths labelled by k (A;=l,2,...w) with different travelling 
time t a b(k) of the system and different probability p a b{k) for the system to 
take the path k. This is called path probability distribution. 

The path probability distribution is defined as follows. Suppose an en- 
semble of a large number L of identical systems all moving in the phase space 
from cell a to cell b with w possible paths. We observe systems travel- 
ling on the path k (k = l,2...w). The probability p a b{k) that the system 
take the path k is thus defined as usual by p a b(k) = -j-. We naturally have 
J2k=iPab{k) = 1. By definition, p a b{k) is a transition probability from state 
a to state b. 

In this work, the path probability distribution due to dynamic instability 
is studied in connection with information theory and the principle of least 
action. First of all, we suppose that the different paths of the nonequilibrium 
systems moving between the phase cells a and b are uniquely differentiated 
by their action defined by 



where L^(t) is the Lagrangian of the system at time t along the path k and 




(1) 



2 



is defined by Lk(t) = Uk{t) — Vk(t) where £4(i) is the total kinetic energy 
and Vfc(i) the total potential energy of the system. The integral is carried 
out along a path k during t a b(k), the travelling time of the system along 
the path. This is an essential assumption of this work. If the paths can 
be identified only by their actions, then it will be possible to study their 
probability distributions with the information concept and the method of 
maximum information of Jaynes[ l] in connection with our knowledge about 
action. This approach will leads us to a probabilistic interpretation of the 
mechanical principle of Maupertuis and a probability distribution depending 
on action. As an application, the obtained path probability distribution will 
be used to derive the transition probability of Brownian motion. 

2 A path information 

The information we address here is our ignorance about the system under 
consideration. More we know about the system, less there is information. 
According to Shannon[5], this information can be measured by the formula 
S = —J2iPi m Pj where pi is certain probability attributed to the situation i. 
We usually ask Ya Pi — 1 with a summation over all the possible situations. 

Now for our ensemble of w possible paths in Figure 1, a Shannon infor- 
mation can be defined as follows : 



H(a, b) is a path information and should be interpreted as the missing infor- 
mation necessary for predicting which path a system of the ensemble takes 
from a to b. 

According to our starting assumption, the quantity that differentiates the 
paths and their probability of occurrence is the Lagrangian action. In what 
follows, a statistics is developed on the basis of this assumption. 

3 Probability distribution of maximum infor- 
mation 

We consider the ensemble containing a large number of the studied system 
moving from a to b. These systems are distributed over the w paths according 




(2) 



fc=i 



3 



to Pab(k) in connection with the action A ab {k). An expectation of the action 
over all the possible paths can then be calculated by 



Aab = ^p ab (k)A ab (k). 



(3) 



k=l 



On the other hand, the path information H(a,b) in Eq.(2) is concave as 
a function of normalized probability p a b{k). According to the principle of 
Jaynes, in order to get the optimal distribution, H(a, b) can be maximized 
under the constraints associated with our knowledge about the system and 
the relevant random variables, i.e., with the normalization of p a b{k) and the 
expectation A ab : 
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-H(a, b) + a ^ Pab(k) + rj ^ Pab{k)A ab (k) 



k=l 



k=l 







This leads to the following distribution 



(4) 



Pab(k) = — exp[-r]A ab (k)} 

Putting this distribution into H(a, b) of Eq.(2), we get 

d 

H(a,b) = \nQ + r]A ab = \nQ -7]— InQ 

or] 

where Q is given by Q = Y^k=i exp[— r)A ab (k)} and A ab is given by 





A 



ab 



InQ. 



(5) 



(6) 
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4 Stability of the path probability distribu- 
tion 

Now we shall show that the above distribution is stable with respect to the 
fluctuation of action. Suppose that each path is cut into two parts 1 (the 
segments on the side of the cell a) and 2 (the segments on the side of b). All 
the segments 1 are contained in the group 1, and all the segments 2 in the 
group 2. Each group has a path information H\ — Hi = H and an average 
action A\ = A2 = A. The total information is then H(a, b) = H± + H2 — 2H 
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and total average action is A(a, b) = A\ + A 2 = 2A. If now we consider a 
small variation of the division of the paths with virtual changes in the two 
groups such that 8A\ = 5 A = — 5A 2 , the total information will be changed 
and can be written as 



H'(a, b) = H(A + 5 A) + H(A - 5 A) (8) 

In view of the fact that the distribution Eq.(5) and the relationship Eq.(6) 
are consequence of maximum information, the stability condition requires 
that the information does not increase with the virtual changes of the two 
groups. We must have 

5H = H'(a,b) - H(a,b) < 0, (9) 

i.e., 

H(A + 5 A) + H(A - 5 A) - 2H(A) < (10) 

which means 

d 2 H 



dA 2 



<0. (11) 



Now let us see if this stability condition is always fulfilled. From Eq.(6), one 
gets = J^. Then considering the definition of average action Eq.(3), we 
straightforwardly calculate 



which implies 

d 2 H 1 



8A 2 a 



< (13) 



where the variance a 2 = A 2 — A 2 > characterizes the fluctuation of the 
action A. This proves the stability of the maximum information distribution 
Eq. (5) with respect to the action fluctuation of the paths. 
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5 Application to Brownian motion 



What is the parameter r\ in the path probability distribution Eq.(5)? A pos- 
sible physical meaning of r\ can be found with a special example : Brownian 
motion. Suppose a certain path in Figure 1 along which a Brownian particle 
moves from a to b via an intermediate point or cell k. Between the three cells 
a, k, and b, the particle is free. The action A ab (k) of the particle from a to b 
can be calculated to be [71 



Aab(k) 



m(x k - x a ) 2 m(x b - x k )' 
2(tfc — t a ) 2(t(, — tk) 



(14) 



Then from Eq.(5), we have 

1 



Pab(k) 



Q 



exp 



—mrj 



Xn 



2(tfc — t a ) 



exp 



—mrj 



(x b - x k ) 2 
2(tb — tk) 



(15) 



On the other hand, it is known [6] that, as a solution of the diffusion equation, 
the transition probability for the particle to go from a to b via k is 



Pab(k) 



PakPkb 



(16) 
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[AnD(t k - t a )fn 
1 

[AnD(t b - t k )] d l 2 



exp 



exp 



{Xk %a) 

~AD(t k -t a ) 
(x b - x k ) 2 
AD{t h -tk) 



where D is the diffusion coefficient supposed constant everywhere in the phase 
space, t a , tk and U are the time and x a , Xk and Xb the position coordinates 
of the particle at a k and b, respectively, d is the dimension of the ordinary 
configuration space, p a k and pkb are the transition probabilities of the particle 
from a to k and from k to b, respectively. A comparison of Eq.(15) and 
Eq.(16) leads to 



V 



2mD 



(17) 



where m is the mass of the particle. We see that the parameter r\ is related 
to the diffusion coefficient D. 

For a system containing a large number of Brownian particles, the above 
result is still valid. The only difference is that, in this case, there are just more 
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intermediate points and the total action will be calculated over all particles 
each having a large number of intermediate points. The above result can be 
used for many thermodynamic systems modelled with Brownian particles. 

If we suppose that the self diffusion coefficient can be approximated by 
Stokes-Einstein relation D = „ fcgT D of a self-diffusion of the Brownian parti- 
cles in a dilute medium, we get 

V= 2^f (18) 

where r]o is the viscosity of the medium, R is the radius of the Brownian par- 
ticles, ks is the Boltzmann constant and T the temperature of the medium. 
In this case, the path probability distribution Eq.(5) becomes 

P^) = ^exp[-^]. (19) 

where A a b(k) = 6n ^ i R A a b(k) . This shows a temperature dependence of path 
probability distribution. 



6 The principle of maximum information and 
the principle of least action 

Now we turn our attention to the connection between maximum path in- 
formation and least action. It can be shown (see below) that the paths of 
least action are the most probable paths provided r\ = 9 ^-i a ' b ^ > 0. In fact, 
from Eq.(5), positive r\ obviously implies that the paths of smaller action 
are statistically more probable than the paths of larger action. So the most 
probable paths must minimize the action. 

This property of the distribution Eq.(5) can be mathematically discussed 
in the same manner as the stability of the distribution proved in section 4. We 
still consider the two groups 1 and 2 of path segments with H\ = H 2 = H 
and A\ = A 2 = A. The total information is then H(a, b) = 2H and the 
total average action is A(a, b) = 2A. Now suppose that the two groups are 
deformed such that 5 Hi = 5H = —5H 2 . The total average action after the 
group deformation can be written as 

A'(a,b) = A 1 (H 1 + 5H 1 ) + A 2 (H 2 + SH 2 ) (20) 
= A(H + 5H) + A(H — 5H). 
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If the distribution Eq.(5) and the relationship Eq.(6) correspond to least 
action, the total average action after the group deformation can not decrease: 
5A = A'(a,b) - A(a,b) > 0, i.e., 

A(H + SH) + A(H-5H)-2A(H)>0 (21) 



which means 

d 2 A 



> 0. (22) 



dH 2 

On the other hand, with the help of Eq.(6), we can prove: 

d 2 A 1 dr\ 1 dr\ 
'dH 2 = ~^fdH = ~^fdA' 

Now considering |^ = — pr, we get 

d 2 A 1 



(23) 



(24) 



dH 2 a 2 r] 3 
We see that if Eq.(22) is true, we have 

V > °- (25) 



In other words, the positivity of rj implies that the principle of maximum 
path information is intrinsically connected with the principle of least action: 
the most probable paths given by the distribution of maximum information 
are just the paths of least action. 

In view of the relationship Eq.(17), the positivity of rj is ensured by the 
positivity of diffusion coefficient D. We can also invert this statement: if 
the most probable paths derived from the probability distribution Eq.(5) 
minimize the action, then the diffusion coefficient must be positive. 



7 Concluding remarks 

It is hoped that this work may contribute to the study of the behaviors of 
chaotic systems. If there is no chaos, the path information will vanish and 
there will be between two phase cells only a fine bundle of parallel paths which 
are the paths of least action with unitary probability of occurrence. More the 
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system under consideration is chaotic, more there are possible paths with dif- 
ferent actions, and larger the information is. So we conjecture that the path 
information H(a, b) may be used as a measure of chaos, like Kolmogorov-Sinai 
entropy (KSE)[8]. It should be noted that there is an important difference 
between H(a, b) and KSE. H(a, b) is an information associated with different 
paths relating two phase cells but having arbitrarily different travelling time. 
In the language of discrete time iteration, the different paths have arbitrarily 
different number of step of iteration. On the other hand, KSE can be de- 
fined as an information associated with different paths that leave the initial 
cell with arbitrary destination but same travelling time, i.e., same number of 
step of iteration [8] . Further investigation is necessary in order to clarify the 
relationship between these two information measures for chaotic systems. 

The result of this work is in accordance with the path integral formula- 
tion of quantum physics and the idea that dynamic systems can be viewed 
as geodesic flows on the manifolds in T-space[l, 2]. This idea was proposed 
several decades ago and used in, among others, the description of violent re- 
laxation of self-gravitating TV-body systems, in Yang-Mills theories and gen- 
eral relativity [1]. It is known that the least action solutions of the Yang-Mills 
equation and the most probable least action geometries of spacetime summed 
for Feynman path integrals correspond to instantons which are so important 
in quantum field theory, quantum chromodynamics and cosmos evolution [3]. 
We would like to mention here a recent development of gravitational instan- 
ton physics which shows that a modification of Feynman path integrals in 
the fractal geometries of space (sum over dimensions instead of over 
paths) can not only reinforce the physical interpretation of the existence of 
instantons, but also allow one to calculate accurately the mass of several 
high energy elementary particles[3]. This is an very encouraging result for 
the attempts to calculate information, action integrals and Feynman path in- 
tegrals in discontinuous and nondifferentiable space (strange attractors, for 
example) in which the result of present work has been used to derive the 
method of maximum entropy change for dynamic systems moving in fractal 
phase space [9]. 

Summarizing, a path information is defined for an ensemble of possible 
paths of chaotic systems moving between two cells in phase space. It is 
shown that, if we suppose that the different paths are physically identified 
by their actions, the maximization of the path information leads to a path 
probability distribution as a function of the action. As a special example, the 
transition probability of Brownian particles is derived. In this case, we show 
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that the most probable paths derived from maximum information minimize 
the action. This suggests that the principle of least action, in probabilistic 
situation, is equivalent to the principle of maximization of information or 
uncertainty associated with the probability distribution. This result may 
be considered as an argument supporting this method of best guess [4] for 
nonequilibrium systems. 
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► 

Position x 



Figure 1: Possible phase space paths (k = 1,2. ..w) for a chaotic system to 
go from the points in the phase cell a to the points in the phase cell b during 
the time t a b(k) (along the path A;). 
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